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INTRODUCTION 

The  adaptive  LMS  linear  transversal  filter  has  been  used  successfully  in  measuring 
narrowband  spectral  lines  in  broadband  noise  for  cases  of  low  signal-to-noise  ratios.  In  this 
context  it  has  been  referred  to  as  the  Adaptive  Line  Enhancer  (ALE)  since  this  device  alters 
its  weight  to  enhance  signals  buried  in  noise. * >2.3  in  other  applications  it  has  been  utilized 
successfully  as  a spectrum  estimator.^ 

The  weights  of  the  ALE  adapt  in  a manner  such  that  the  mean  squared  error  is  mini- 
mized. In  all  these  applications  its  performance  is  usually  analyzed  in  terms  of  the  Wiener 
filter  theory.  To  assess  the  detection  performance  and  tracking  capabilities  of  the  ALE,  the 
estimation  of  convergence  time  becomes  important.  The  area  pertaining  to  the  overall  con- 
vergence properties  of  the  ALE  has  been  extensively  treated  by  John  Treichler.5  His  thesis 
encompasses  the  mean  steady  state  and  mean  transient  behavior  of  the  ALE  in  both  station- 
ary and  non-stationary  signal  environments.  The  transient  results  show  that  the  mean  weight 
vector  possesses  anmitial  ramp  response  whose  slope  js  related  to  the  adaptive  constant  p, 
the  modal  matrix  Q,  and  the  cross  correlation  vector  Ps.  Because  the  analysis  is  treated  in  a 
statistical  mean,  the  fine  structure  of  the  weight  vector,  an  oscillatory  start-up  phase,  does 
not  appear  in  the  results. 

This  paper  attempts  to  explain  the  mechanism  associated  with  the  initial  transient 
response  via  direct  solution  of  the  LMS  algorithm. 

TRANSIENT  BEHAVIOR 

Conceptually  the  ALE  is  as  shown  in  Figure  1.  The  LMS  algorithm,  i.e.,  the  law 
which  governs  the  time  history  of  the  weight  vectors  is  given  by: 

Ws(n  + 1)-Ws(n)=2p  fx(n)-  ^ Wg(n)  x (n  - « - 5)1  x (n-s-5). 

L e=o  J 

Dividing  both  sides  of  the  equation  by  a time  increment  A one  obtains: 


Ws(n  + l)-Ws(n)_2M 
A ~A 


[■  (n)-  Wg(n)  x (n  — C — 6)j 


x (n  -s  - 8) 
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Define  the  L X 1 vectors  as: 


o 1 

W(n)=- 


Figure  1.  ALE  configuration. 

W0(n  + 1)-W0(n)  I 
W,(n  + 1)  - Wj(n)  j 


,p<n)=^ 


x(n)  • x(n  - 6) 
x(n)  • x(n  - 1 - 5) 


W(n)  = 


[WL_1(n+l)-WL.1(n)J 
W0(")  1 

WjCn) 


WL-l(n) 


x(n)  * x(n  - L + 1 - 5) 


and  the  L X L matrix  as: 

x(n-6)  x(n-6)  x(n-S)  x(n-l-8)  x(n-6)  x(n-2-8)  . . . 

x(n-l-5)  x(n-8)  x(n-l-6)  x(n-l-6)  x(n-l-6)  x(n-2-6). . 

A(n)  = ^ x(n-2-6)  x(n-6)  x(n-2-8)  x(n-l-6)  x(n-2-8)  x(n-2-8) 


. .x(n-8)  x(n-L+l-5) 

. .x(n-l-6)  x(n-L+l-6) 


|^x(n-L+l-5)  x(n-6) 

Then  this  notation  simplifies  to  the  difference  equation 
W(n) g - A(n)  W(n)  + P(n) . 


.x(n-L+l-8) x(n-L+l-8) 
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whose  continuous  solution  is 


»/A(t)  dt  = Je  /A(t)  dt  dt  + C, 


and  C is  a constant  vector  of  integration.  Or 


Wft)  = e'WV  dt  ^e/A(t)  dt  p(t)  dt  + C . 


For  all  practical  purposes,  it  shall  be  assumed  that  C is  the  null  vector  since  this  implies  that 
all  the  initial  weights  are  set  to  zero.  Thus 

Wft)  = e'MW  dt  je^A(t)  dt  P(t)  dt, 

and 

e-/A(t)  dt  - j _ J A(t)  dt  + ~ [y A(t)  dtj  |y A(t)  dtj  . . . etc. 

Note  that  the  matrix  A(t)  contains  a multiplicative  factor  of  2p,  where  p < 1 . Thus  for  the 
initial  transient  time,  the  following  approximation  holds: 

e-/A(t)  dt  * j _ jA(t)  dt  # 

This  leads  to  the  following  result: 

MU  * [I-/A(t)dtJ  J [I+/A(t)dt]  P(tldt. 

Further  simplification  is  obtained  by  neglecting  orders  of  2 p greater  than  one: 

W(t)^ / P(t)  dt. 

This  result  shows  that  the  initial  transient  response  of  the  weight  vector  is  directly  related  to 
the  cross  correlation  vector. 

The  analysis  that  follows  will  assume  all  terms  whose  order  of  p is  greater  than  one 
to  be  negligible.  This  assumption  is  valid  for  the  initial  adaptation  since  for  sinusoidal  inputs 
in  white  noise,  the  average  weight  vector  varies  as  pt,  so  initial  transient  time  will  refer  to  all 
pt  < .1  or  t < .1/p. 

APPLICATION 

Consider  the  case  where  the  input  x(t)  consists  of  a line  contaminated  by  noise.  Let 


where: 


x(t)  = A Sin  (wgt  + 6)  + n(t), 

0 is  a fixed  phase 

n(t)  is  zero  mean,  white  noise. 


Assume  the  filter  to  possess  an  initial  bulk  delay  5 . The  vector  P(tl  is  then  given  by , 

x(t)  x(t  - 8) 
x(t)  x(t  - 8 - T) 
p(t)  = x(t)x(t-6-2T) 


|x(t)  x(t  — 8 — (L  — 1 ) T)J 

where  T is  an  element  delay  of  the  ALE.  Thus  an  element  of  the  vector  W£t)  say  Wg(t)  is 
given  by 


Wg(t)  =^r  / X<T)  • x(T  - 8 - CT)  dr. 


For  sinusoidal  inputs, 


2 

Wg(t)  = ^p  J Sin(wgT  + 0)  Sin(ojg(T-a)  + 0)dr 


a = 8 + fiT. 

After  performing  the  integration  and  evaluating  the  result  at  the  limits,  the  following  is 
obtained: 

a2„  |(t  - a)  Cos  (acon)  Sin  (2cont  + 20  - aco0)  Sin(woOi  + 20) 

W6(t)=-/ 2^  + 2^ 


fortS*  a.  UJ 

This  result  shows  that  the  initial  transient  weight  behavior  of  the  ALE  under  sinusoidal 
inputs  or  possibly  high  signal-to-noise  ratio  inputs  consists  of: 

a.  a ramp  shifted  in  time  by  a and  whose  slope  is  given  by  A2m/A  Cos  (aa>0), 

b.  a sinusoidal  variation  of  amplitude  A2/jt/2a>QA,  frequency  2ojq,  and  phase  20-oujq, 

c.  a constant  term  given  by  A2m/2coqA  Sin  (aig®  + 20)- 

TEST  CASE 

To  determine  how  accurately  the  result  given  by  Equation  1 approximates  the  tran- 
sient weight  behavior  of  the  ALE,  a digital  computer  program  in  FORTRAN  V language  was 
written.  The  following  parameters  were  utilized  in  the  digital  simulation  of  the  ALE: 


t 


a.  0=0° 

b.  5 = 0 

c.  A = 1 

d.  T = 1 

e.  cjq  = 0.2ir 

f.  m = .01 

g.  A =1.0 

For  this  case  the  theoretical  wg  reduces  to 

Wg(t)  = .01  [(t  - 8)  Cos  36°£  - .8  Sin  (,4irt  - 36°£)  + .8  Sin  36°8] . 

Setting  t = nT 

Wg(n)  = .01  [(n  - E)  Cos  36°£  - .8  Sin  (72°n  - 36°E)  + .8  Sin  36°£]  . (3) 

SIMULATION  RESULTS 

Figures  2,  3 and  4 show  a comparison  of  the  results  obtained  via  a digital  simulation 
of  the  ALE  filter  and  the  theoretical  results  utilizing  Equation  3.  It  should  be  kept  in  mind 
that  Equation  3 was  obtained  via  continuous  integration  of  the  cross-correlation  vector.  This 
is  equivalent  to  a system  whose  time  increments  T are  small.  For  this  reason  this  expression 
is  termed  “Continuous  Theoretical.”  For  other  cases,  it  might  be  more  meaningful  to  com- 
pare simulated  results  with  the  discrete  direct  solution 

n=m 

Wg(mT)  = ^ £ x(nT)  x(nT  - 6 - £T).  (4) 


The  term  given  by  Equation  4 is  called  “Discrete  Theoretical.”  It  can  be  seen  from  the 
results  that  both  representations  agreed  well  with  the  experimental  data.  Figure  5 shows  the 
experimental  transient  and  steady  state  behavior  of  weights  cjq,  cuj  and  a>2  superimposed 

on  one  graph.  Here  the  ramp  and  oscillatory  start  up  phase  is  more  evident  since  the  time 
index  n has  been  compressed. 


WEIGHT  VALUE,  WJn) 


continuous  theoretical 


WQ(n)  = 0.01  | n -.8  Sin  72°  n } 


measured 

discrete  theoretical 


Figure  2.  Initial  transient  response  of  first  weight  (W0(n))  of  the  ALE. 
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WEIGHT  VALUE,  W2(n) 
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SAMPLE,  n ► 

Figure  3.  Initial  transient  response  of  the  third  weight  (W-,(ri))  of  the  ALE. 
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WEIGHT  VALUE,  WR(n) 
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